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(54) Method and apparatus for deriving separate images from multiple chromogens in a 
biological specimen 



(57) A system for collecting images at multiple 
wavelengths for image analysis of biological specimens. 
The process separates contrasts for images of a biolog- 
ical specimen prepared with a chromogen. Light wave- 
lengths matched with each chromogen optimize 
separation for each image. Computing attenuation coef- 
ficients and extinction coefficients for each chromogen 
provides for determination of the concentration of each 
chromogen. A chromogen separator allows for subtract- 
ing predetermined chromogens to generate new 
images and aid in identification of cell morphology. The 
system can perform the image analysis of the new 
images using image processing techniques such as 
segmentation, feature calculation and object classifica- 
tion. At each stage of image processing, data from each 
of the new images may influence the processing of the 
other images. 
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Description 

Field of the Invention 

5 Sis J^ZS^* ° f m0 ' eCU,ar markGrS ^ " aUt ° ma,ed miCr ° SC0Pe Uti,i2in9 C ° mpUter 

BACKGROUND OF THE INVENTION 

10 S^L Ar 16 ^ marker is a chemical that binds with high specificity to a predetermined chemical target inside 
or on the surface of a cell or to particular molecules suspended in a biological fluid specimen. In common use are 
molecular markers for proteins, in which case a marker acts as an antibody to a targe, amigen, and for nucTeic acids n 
which case a marker is a strand of DNA or RNA with a base sequence complementary to that of the target Attachment 
of antibody to the antigen is called "binding". Attachment of the nucleic acid p'obe to its «^m3SeS?2S 

amou ft 0 f? ma,e f det6Cti0n '° Cali2ati0n ° f th6Se 3,taChmen tS and ' in some — • quantSon of he 
loZ .IT f em 'T attaChin9 ' rtSe ' f 10 tar96tS ' Can impr ° Ve the ? erf °"™<* 01 automated microscopes used to 
screen specimens for indications of disease. These same methods can also be useful in research for medicine and bio° 
ogy, d.scovery and testing of pharmaceuticals and in toxicological testing of chemical agents 

[0003] The invention applies to molecular markers that utilize light absorbing dyes, also known as chromoaens as 
20 opposed to dyes that fluoresce in the presence of excitation or that radiate photons as a product of rS£3£S 
or chemica reaction The genera, approach to staining a specimen with such a marker comprises the steps o concen 
tration, capture, fixat.on, mcubation, and development. Concentration and capture take many forms but result in The 
attachment of the cells or molecular components of interest to some surface suitabie for examine ion byThe micro 
« ?« ■ w , Xa T yS6S CeMS in the Sp6Cimen and Preserves ,hem from deca y- '"Nation exposes the eels or bToloo- 
25 IT t0 th f ant ' b0dy nUC ' eiC add m0 ' eCU,eS ' WhiCh h3Ve been at,ached t0 subst -te mo.ecu.es that ^compS, 
lub Jrj" 9 . 9en " an,lb ° dy Wnding ° r nUC ' eiC add h V bridization during incubation. During development he 

substrate undergoes a react.on typically catalyzed by an enzyme to produce an insoluble, light-absorbing precipitate A 
further step m the deve.opment process includes washing away the unbound marker, leaving precipitate only T tose 
areas where binding or hybridization have occurred. y 

30 LmduL ^, hr0r "° genS are Se,ec,ed for their fi 9ht absorption characteristics. Absorption of a particu.ar wave.ength 
produces co.or at a complementary wavelength. Multiple chromogens can be used on a specimen. Typically a set of 
chromogens ,s used to stain cellu.ar structures for morphologica, analysis and a single chromogen that yields a oTstTnc 
tive color is used as a molecular marker. ay urc>unc 

[0005] When such biochemical markers are used in conventional microscopy, a trained specialist views the imaae 
as from the microscope and searches for structures of the color produced by the chromogen o interest A IVaemZ is 
then made of the clinical significance of the appearance, if any, of the marker. This judgement m^y be based onle 

rrroftrir s a r e9reeo,morp " 

[0006] Therefore, it is one motivation of the invention to provide an automated screening system that uses this infor- 
<o mation to automatically ana.yze a biological specimen. It is a further object of this invention to separairnVoTecTar 
marker information from morphological features. separate molecular 

SUMMARY OF THE INVENTION 

45 [0007] A method for biological specimen image analysis on a plurality of images collected at multiple wavelenqths 
comprising the steps of: applying a chromogen separator to the plurality of images to generate a set of new imaqes- 
segmenting the each image of the set of new images to provide a plurality of segmented outputs; pe r,2ing7ea?ure 
calculation on each of the p.ura.ity of segmented outputs wherein data from each of the segmented outputs is used on 

so ZlTJt T Tr 10 rT 3 P ' Ura,ity ° f f6atUre Ca ' CUlati0n reSU ' tS; performin 9 ob i ect c.assificaL on each of 
so the feature calculation results wherein data from each of the feature calculation results is used on each object classifi- 
cation to provide a plurality of object classification results; integrating the object classification results to provide a field 
of view score integrated output; and generating a slide score from the field of view score integrated output 
IHLnh ° bjeC ! S ' feat T S and advanta9es of the P rcsent inven,ion will become apparent to those skilled in the 
55 etemeTs ^"P" 0 " ° f the pre ' erred emb ° di ™nt, claims and drawings herein wherein like numera.s refer to like 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] To illustrate this invention, a preferred embodiment will be described herein with reference to the sccompa- 
nyin.g drawings. 

5 

Figure 1 shows a system for collecting images at multiple illumination wavelengths. 

Figure 2 shows a process flow diagram for the automatic generation of a biological specimen analysis score from 
one or more wavelength images. 

Figure 3 shows a graph of relative attenuation to wavelength that may be used to match optical filters to chro- 
io mogens. 

Figure 4 shows a graph of normalized attenuation to wavelength for six wavelengths. 

Figure 5 shows a process flow diagram for the determination of new images based on chromogen separation. 
Figure 6 shows a process flow diagram for the offline measurement of extinction coefficients from a specimen con- 
taining a single chromogen. 

75 Figure 7 shows a process flow diagram for the online measurement of extinction coefficients from a specimen con- 

taining multiple chrornogens. 

Figure 8 shows a process flow diagram of an iterative operator for extinction coefficient calculation. 
Figure 9 shows an image of a biological specimen collected using a 509 nm filter. 
Figure 10 shows an image of a biological specimen collected using a 555 nm filter. 
20 Figure 1 1 shows an image of a biological specimen collected using a 608 nm filter. 

Figure 12 shows a mask for selecting nuclei. 

Figure 13 shows an image of a biological specimen collected using a 555 nm filter minus information from objects 
stained with a chromogen. Figure 14 shows an image of a biological specimen collected using a 555 nm filter 
minus information from objects stained with two chrornogens. 
25 Figures 15A, 15B and 15C show an apparatus for automated biological specimen analysis. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0010] The invention relates to the general field variously referred to as computer vision, machine vision, visual 

30 intelligence, or computational image analysis as applied to biological specimens using light absorbing dyes. In the 
instruments using this technology, a human observer's vision and interpretation of what is seen is replaced by the col- 
lection of digitized images and the calculation of parameters that express the information content of those images. 
Human observers often derive information from the color of what is viewed. Color is perceived when the light reaching 
the observer's retina varies in intensity over the visible spectrum. Chromogens attached to a specimen viewed under a 

35 microscope produce a color by absorbing the light at that color's complementary wavelength. The observer sees blue, 
for instance, when yellow light is heavily absorbed. By using a chromogen that absorbs yellow light as the dye compo- 
nent of a molecular marker, the objects containing the target molecules appear blue. The invention provides a method 
and apparatus for making this chromatic information available to image processing processes of a visual intelligence 
instrument. Fundamental to the invention is the collection of images in which the image contrast is produced by absorp- 

40 tion of light transmitted through the specimen and in which each image utilizes measurements of light at a particular 
narrow wavelength band. Figure 1 shows one example embodiment for implementing this method. 
[0011] Now refer to Figure 1, which shows a system for collecting images at one or multiple illumination wave- 
lengths and generating a biological specimen analysis score. A fixed biological specimen 10 is deposited on a micro- 
scope slide to create a specimen slide 12. The microscope slide 12 may be a cervical cancer smear, blood sample, 

45 sputum specimen, urine, bone marrow, spinal fluid or any other cellular biological specimen. During preparation of the 
microscope slide 12, the fixed biological specimen 10 is stained with a molecular marker stain 14. The molecular 
marker stain 14 may comprise an antibody and associated dye or a nucleic acid and associated dye or any other molec- 
ular light absorbing dye. Also during preparation of the microscope specimen slide 12, a fixed biological specimen 10 
is stained with a morphology stain 1 6. The morphology stain is comprised of a light absorbing dye such as a Pap stain, 

so Romanowski stain, Wright-Giemsa or any other cellular morphology stain. See Biological Stains , by H.J. Conn, 9th edi- 
tion, Williams & Wllkins Co., for information on morphology stains. 

[0012] A monochromatic camera 18 receives an image from an objective 20 of the slide 12 in a conventional man- 
ner. The filters 24 filters light from light source 28 received through condenser 26. During operation, multiple images of 
the slide 1 2 are taken using different filters. The multiple filters may be automatically moved into position to take the mul- 
55 tiple images in a conventional manner or an electronically controlled variable filter may be used when taking the multiple 
images, each image being taken at a different wavelength. The camera 18 generates a number of images shown as 
images 30A-30C. Image 30A corresponds to an image taken with a filter at a first wavelength. Image 30B corresponds 
to an image taken with a filter at a second wavelength. Image 30C corresponds to an image taken with a filter at an nth 
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wavelength. This system is shown in more detail as the AUTOPAP from NeoPath, inc. of Redmond, Washington. Spe- 
cifically, the structure and operation of the image processing elements of the system are shown in more detail in Figures 
15A, 15B and 15C. 

[0013] In operation, light from the broadband incandescent light source 28 passes through the filters 24 on its path 

5 to the specimen slide 12. This illumination is focused by the condenser 26 onto the plane of the specimen slide 12. The 
light transmitted through the specimen slide 12 is collected by the objective 20, which forms a well focused image at the 
face of the electronic camera 18. The camera 1 8 captures an image at each illumination wavelength of a set of illumi- 
nation wavelengths. Multiple filters or a single filter having a variable center wavelength in its passband may provide the 
illumination wavelengths. The captured images 30A, 30B and 30C are either immediately processed or stored in an 

io electronic memory or other storage medium for later processing. 

[0014] With this hardware configuration, it is important that the microscope stage, shown in more detail in Figure 
1 5C, optical components, and camera 1 8 are all effectively isolated from vibration so that the captured images are prop- 
erly aligned with one another. The maximum spatial offset between images taken of the same location with different fil- 
ters should be held to less than a fraction of a pixel width. 

15 [0015] It is also important that all of the images for a field of view are well focused. See assignee's United States 
Patents and co-pending patent applications incorporated by reference herein. The system must have stability of the 
microscope stage in the vertical direction, but also be able to eliminate the effects of chromatic aberrations in the image 
forming optics. Note that the term "field of view" refers to a region in the specimen with dimensions defined by the active 
area of the camera 18 divided by the magnification of the image-forming optics. Multiple images will be collected from 

20 a single field of view by keeping the stage stationary between image capture events. 

[0016] A variety of alternative configurations of the apparatus are equally applicable to the invention. The wave- 
length selection can be accomplished in the light path between the objective and the camera, for example. Furthermore, 
separate cameras, each having its own optical filter at a particular wavelength can be utilized to allow simultaneous col- 
lection of multiple images. 

25 [0017] The camera 18 may be electronic, using a charge-coupled device array or other type of electronic light sen- 
sor, or may be a film camera, in which case the storage medium is photographic film. Furthermore, those skilled in the 
art will recognize that the wavelength separation in the image collection system may be accomplished through the use 
of prisms or gratings rather than light absorbing filters. 

[0018] Refer now to Figure 2 which shows the apparatus and method of the invention to generate a slide score from 
30 multiple images of a slide taken at different wavelengths. In step 32, the process starts by capturing multiple images of 
the slide 12 at wavelengths specifically designed to match to a chromogen. This matching relationship is shown in Fig- 
ure 3 as a wavelength vs. relative attenuation diagram. Chromogen 1 is matched to filter 1 . It will be noted that some of 
the signal from chromogen 2 will also be passed by filter 1. 

[0019] The general configuration of the image processing of the invention is shown in Figure 2. Images collected at 
35 multiple wavelengths are translated into a second set of images, new image 1 36A, new image 2 36B and new image 
N 36C, by the chromogen separator 34. The chromogen separator 34 is a computational tool that will be described in 
detail herein. Each of the new images, new image 1 36A, new image 2 36B and new image N 36C, is processed in an 
information processing branch 38A, 38B or 38C to extract information content. Each processing branch 38A, 38B and 
38C is comprised of the general operations of object segmentation 40A, 40B and 40C, object feature calculation 42A, 
40 42B and 42C, object type classification 44A, 44B and 44C. See assignee's U.S. Patents and assignee's copending U.S. 
patent application incorporated by reference hereto for more detail on these operations. Each processing branch also 
performs specimen scoring. The specimen score from each branch 38A, 38B and 38C is integrated in field of view 
score integrator 46. In one embodiment, object segmentation may be accomplished by rule-based processes or pattern 
matching. Object classification may be accomplished using methods that include, but are not limited to, rule-based deci- 
45 sion trees and, alternatively, artificial neural networks. Processing may occur in the space domain, the spatial frequency 
domain, or both. 

[0020] The image processing of the invention branches out beyond the chromogen separator to analyze each 
image separately. However, cross-connections shown by connection 41 between branches 38A and 38B, for example, 
may serve to allow the segmentation masks for one image to select pixels for feature calculation in another branch. Fea- 
50 tures from a first branch may also modify the outcome of processing in a second branch. Connection 45 provides one 
such example of features from branch 42A modifying the processing of object classifier 44B. 

[0021 ] For example, assume that Image 1 is used for morphological cell type classification and that Image 2 is used 
for searching for a molecular marker. Once a cell of a particular type is localized and identified, the pixel locations inside 
of that cell might be sent to the Image 2 processor to check for the presence or absence of the molecular marker. Con- 
55 versely, upon detection of a strong molecular marker in Image 2, the Image 2 processor might query the Image 1 proc- 
essor to identify the type of cell showing the marker. 

[0022] The outcome of processing in each branch of the classifier is integrated by FOV score integrator 46 into an 
outcome 47 for the field of view. Multiple fields of view, shown by flow line 49 indicating that the next field of view is to 
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be processed, are collected and processed until the useful area of the specimen has been examined. The parameters, 
resulting from the FOV score integrator for a number of FOVs, stored for the collection of fields of view are then inte- 
grated by slide score integrator 48 into an outcome for the entire specimen reported to the user on report 50. 
[0023] Refer now to Figure 5 which shows the detailed processing steps of the chromogen separator 34 to generate 

s information useful for creating new images for each field of view where the new images have enhanced morphological 
information and/or enhanced molecular marker information. The process starts by computing the relative extinction 
coefficients for all chromogens at all wavelengths in step 52. For example, when automatically analyzing a specimen 
with two chromogens at six wavelengths, as depicted in Figure 4, the relative extinction coefficients from chromogen 1 
at the six wavelengths is computed and the relative extinction coefficients for chromogen 2 at the six wavelengths is 

io computed. Details of the computation are shown below. As will be shown, in one embodiment, the extinction coefficients 
may be computed before analysis of a specimen for a system of chromogen and wavelength processes. This is known 
as "offline" processing. In an alternate embodiment, these extinction coefficients may be computed from a specimen. 
This is known as "online" processing. Those skilled in the art will recognize that if the relative extinction coefficients are 
computed offline, then the chromogen separator will use the values previously stored for system chromogens and 

75 wavelengths. 

[0024] After the relative extinction coefficients are computed by either method, the process flows to step 54 to con- 
struct a system of equations for attenuation as a function of concentration. 

[0025] The process then flows to step 56 to invert the system of equations to solve for concentration. Knowing the 
concentration at a pixel location and the relative extinction coefficients for a chromogen at a particular wavelength per- 

20 mits the construction of a new image by creating a table of coefficients, examples of which are shown in Table 1 and 
Table 2 in step 58. In step 60, the new images are created. This processing will now be described in more detail. 
[0026] The first step in the optimization of the performance of the chromogen separator 34 is the selection of chem- 
ical dyes to meet the requirements of a particular application and the selection of optical filters 24 to match their absorp- 
tion characteristics. A large number of chemical dyes for biological applications are commercially available, and their 

25 manufacturers provide information on their absorption spectra: Optical filters can then be selected to match the absorp- 
tion peaks of the chromogens, as shown in Figure 3. 

[0027] Electronic images are typically stored using binary or integer data formats and have quantization accuracy 
limited by the number of bits used to digitize the camera 18 output. Each pixel in the image is assigned a value on the 
scale of possible values, which is known as the grayscale. For the purpose of this invention, it is important that the gray- 
30 scale value be directly proportional to the light intensity reaching the face of the camera 1 8, as is the case for charge- 
coupled device cameras. Any deviation from this direct proportionality to intensity, such as might be introduced by non- 
linearity in the signal processing hardware, should be corrected before the images can be used in the manner described 
herein. Once corrected, the grayscale value can be expressed in terms of attenuation in the specimen, as follows: 

35 G n (i,j)=G n (0) • e' a(iJ) (1) 

where: 

n - index identifying filter with center wavelength X n ; 

40 Gn('J) = grayscale value for pixel ij in image collected at X^; 

G n (0) = grayscale value for zero attenuation in specimen using filter n; and 

a (U) = attenuation coefficient for pixel i,j. 



50 where 

n = index identifying filter with center wavelength X^; 

Gn (U) = grayscale value for pixel i,j in image collected at A^; 

Gn(°) = grayscale value for zero attenuation in specimen using filter n; and 

55 a n (i,j) = attenuation coefficient for pixel i,j. 

[0028] The image capture system is capable of measuring the attenuation over a finite range of values. This range 
is called the dynamic range of the imaging system. 
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[0029] A first approximation of the range of measurable values for a is found by considering the number of bits in 
the camera signal digitizer or the image storage data format, whichever is smaller, and the zero-attenuation grayscale 
value: 

a max = -mg^ (3 ) 

[0030] This equation derives from the knowledge that the smallest grayscale value meaningful for attenuation cal- 
culation is 1 . If the image data is stored in 8 bits, then the maximum value of G n (0) is 255, and the maximum value of a 
is 5.54. In practice, however, electronic noise, digitizer uncertainty, and photon count would set a minimum useful gray- 
scale value higher than 1 , and G n (0) would be set to a value somewhat less than the full scale of the digitizer. A practical 
range for measurements of a in an 8-bit system is from 0 to 4.0. 

[0031] In order for the chromogen separation method that is central to the invention to function properly, the light 
transmitted through the specimen and focused on the light detecting surface of the camera must remain within the 
dynamic range of the camera. That is, the light transmitted through clear regions of the specimen must not saturate the 
camera or the signal processing electronics. Also, the light transmitted through the most attenuating regions of the 
specimen must not fall below the noise floor or the first level of digitization, whichever is larger. 

[0032] Furthermore, the value of G(0) must be known to an accuracy of a few gray levels for every image. Because 
both the efficiency of light transmission along the optical path for image formation in the system and the sensitivity of 
the camera may vary with wavelength, a method is required either to measure G(0) for each image, or to tightly regulate 
it as wavelength is varied. If the wavelength dependence is substantial, it is preferable to maintain a constant G(0) by 
varying the light level in the illuminator. This approach maintains the imaging system dynamic range. To maintain G(0) 
at a constant level, correction parameters calculated and stored using an instrument calibration method will need to be 
25 used to vary the illuminator light intensity as wavelength is varied. 

[0033] More than one chromogen may contribute to the absorption of light inside the passband of a given filter. In 
fact, since absorption dyes generally display absorption that spreads over a large fraction of the visible light spectrum, 
this effect is likely to happen whenever multiple chromogens are present in a specimen. In the case where this overlap 
of absorption curves occurs inside of a filter band, the attenuation can be decomposed into component parts* 

30 

a nO'>J)= *i.nO\j) +<*2.n('>j) + »- + <* m n (i, j) ( 4 ) 

where: 

35 n = index for filter centered at X^; and 
m = index identifying the chromogen. 

The process then flows to step 54 to construct a system of equations for attenuation as a function of concentration. It 
is known that the attenuation coefficient for a given thickness of absorbing materia! is directly proportional to the con- 
40 centration of the chromogen in that material. The constant of proportionality is known as the extinction coefficient, e. 
The attenuation equation, then, can be expanded as follows: 



55 



« „ = e hn C , + e 2 n C 2 (i,j) + + z C m (i, j) (5) 



45 where: 



e m,n = extinction coefficient for chromogen m and wavelength n; and 

C m ('J) = concentration of chromogen m at pixel location i,j. 

The concepts of concentration and extinction coefficient will be used in a relative sense, and the specimen thickness 
will be assumed to be uniform and not considered in the derivations to follow. We will arbitrarily limit the extinction coef- 
ficients to a range from 0 to 1.0. The concentration will also be known only in a relative sense as the ratio aJz. 
[0034] Refer now to Figure 6 which shows the method of the invention to determine extinction coefficients from 
specimen with a single chromogen. A set of specimens, each specimen containing only one chromogen from the stain 
formula, is prepared. Each specimen is scanned, in step 62, using a microscope with the capability of capturing images 
at multiple wavelengths for analysis. The particular chromogen under examination will stain certain parts of the speci- 
men. The image showing the most attenuation is chosen, in step 64, as the reference image. In step 68 the zero atten- 
uation Gray level for each wavelength is found. The extinction coefficient for the images at each of the other 
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wavelengths will be measured relative to the reference image. The computation must be restricted to pixel locations 
where the chromogen is present. A segmentation mask 70 can be generated using one of a variety of methods. 
[0035] For example, given that the only absorption in the image is by the chromogen, a simple threshold can be 
applied .to the grayscale values in the reference image to create the mask. Alternatively, images from red, green, and 
blue filters can be used to generate color images. These color images could be converted to the Hue, Saturation, and 
Value (HSV) format using a method well known in the art. The segmentation mask could then be generated by selecting 
pixels having hue and saturation values within certain ranges that match the spectral behavior of the chromogen. The 
hue window selects the basic color of the chromogen, while the saturation selects for how much white light is mixed with 
that color. A light blue, for example, scores low on the saturation scale, whereas a deep blue scores high on the satu- 
ration scale. 

[0036] When performing the extinction coefficient calculation, the grayscale values of all of the images are con- 
verted to attenuation values in step 72. The reference wavelength is then assigned an extinction coefficient of 1.0 in 
step 74, and the relative extinction coefficients for the other wavelengths, in step 76, are computed as the ratio of atten- 
uation values as follows: 

El* sec) 



E[A 



refi 



20 where: 



= attenuation in secondary image, a random variable; 
A ref = attenuation in the reference image, a random variable; and 
E[X] = expectation operator, returns the average of random variable X. 

25 

The segmentation mask defines the domains of the random variables, As ec and A ret . 

[0037] The extinction coefficient calculation is repeated over a number of fields of view of the specimen and the val- 
ues are averaged in step 78 to improve accuracy. 

[0038] Now refer to Figure 7 which shows a process flow diagram to perform online measurement of extinction 

30 coefficients. In this case, the extinction coefficients are computed within the instrument that will be used for the actual 
automated microscopy. The specimen will contain all of the chromogens in the dye formula 80. All of the steps in the 
measurement of the extinction coefficient are the same as for the offline method, except for the generation of the seg- 
mentation mask. In step 82 the process selects a field of view and collects images at all wavelengths of interest. In step 
84, the zero attenuation gray level is found for each wavelength. In step 86 grayscale values are converted into attenu- 

35 ation values. For the online method, a unique segmentation mask is created for each of the chromogens in the speci- 
men using an iterative segmentation process 90 based on cross-correlation of the attenuation values^ In step 88, the 
process selects an image with maximum attenuation as a reference image. The reference image for each chromogen 
is an image captured using the optical filter matched to the known peak of that chromogen. Final values are obtained 
by averaging over all fields of view in step 92. 

40 [0039] Refer now to Figure 8 which shows the method of the invention to iteratively determine the extinction coeffi- 
cient. The iterative segmentation process 90 operates by selecting pixels within a range of ratios of the reference atten- 
uation and the secondary attenuation. In step 94, an attenuation window for mask generation is set. In step 96, a mask 
is generated. The range of ratios is modified to increase the correlation coefficient between the reference image pixels 
within the mask and their counterparts in the secondary image. In step 100, correlation coefficients are computed. 

45 The cross -correlation calculations are as follows: 

p(A 1t A 2 )= = (7) 

1 2 JVar(A, • Var(A 2 ) 

50 

where: 

Cov [A v A 2 ] = E [A , • A 2 ] - E [A • E [A 2 ] (8) 
55 \fer [A ,]==£[**]-(£ [A,])* 

Var[A 2 ] = E[A 2 ) = (E[A 2 ]) 2 
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A n = attenuation at wavelength n, a random variable. 



Note that A-, is the random variable that includes all of the values of ct(i, j) in image 1 . Similarly, A 2 is the random variable 
for ct(i, j) in image 2. E[x] is the "expectation value" of the random variable X, which is computed as the average of the 
5 variable x. In the above equations, E[A n ] is the average attenuation value for all the pixels of the image for wavelength 
n inside the segmentation mask. 

[0040] The meaning of the correlation coefficient can be understood by considering a single pixel location in the 
specimen that is stained with Chromogen 1, which has its absorption peak at Wavelength 1. If Chromogen 1 also 
causes absorption at Wavelength 2, but not at Wavelength 3, then as the concentration of Chromogen 1 is increased, 

io the pixel will get darker in both Image 1 and Image 2, but not in Image 3. Now, if we pick out all of the pixels in a field of 
view that contain Chromogen 1 and convert their grayscale values to attenuation values, we will find that there is a high 
correlation between the attenuation in Images 1 and 2, but a low correlation between either of Images 1 and 2 and 
Image 3. In the iterative segmentation operator, we turn the problem around and search for high correlations to help us 
pick out the pixels stained by a particular chromogen. 

15 [0041] The iterative loop can be controlled using an error minimization scheme such as Newton's Method to modify 
the attenuation ratio on each successive pass through the process in such a way as to converge on a particular value 
for the correlation coefficient. In step 98, the process adjusts the attenuation window for mask generation and returns 
to step 96 to generate a mask. Upon convergence, the mask will contain only those pixels that have a high concentra- 
tion of the chromogen in both the reference and the secondary image, in step 102. Certain criteria should be placed on 
20 the convergence, however. First, a considerable number of pixels should be retained in the mask, and, second, a high 
value of correlation should have been accomplished. Reasonable values for these limits might be 1000 pixels in the 
mask and a correlation coefficient above 0.85, although these criteria will need to be optimized through experimenta- 
tion. 

[0042] Using the segmentation mask provided by the iterative correlation algorithm, the extinction coefficient is cal- 
25 culated in step 104 as follows: 
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where: 



A sec = attenuation in secondary image, a random variable; 
A ref = attenuation in the reference image, a random variable; 
35 f = index for the field of view; 

m = index for the chromogen; and 

n = index for the secondary wavelength. 

The extinction coefficient process is repeated 1 06 for all of the chromogens and their associated reference and second- 
40 ary wavelengths for each of a set of fields of view. The number of fields of view is chosen to improve the accuracy of 
the extinction coefficient measurements. The number of fields of view attempted will increase if the iterative operator 
fails to meet the convergence criteria. This event will be encountered whenever the field of view lacks the requisite 
amount of material stained by the chromogens of interest. 

[0043] Note that it may be desirable to use conventional morphological segmentation to generate an initial mask 
45 and to further reduce that mask using the iterative correlation operator. For example, if a chromogen is know to stain 
nuclei strongly, morphological segmentation could be used to selected all objects meeting the shape and size criteria 
for nuclei. The mask of all pixels representing nuclei could then be submitted to the iterative correlation operator to fur- 
ther reduce the mask to the pixels in nuclei stained by that chromogen. 

[0044] As shown in Figure 5, upon completion of the cross-correlation between images with neighboring wave- 
so lengths, the relative extinction coefficients are installed in a set of equations for the attenuation values for each pixel at 
every wavelength. The following set of equations is written for the general' case of w m" chromogens and "n" wave- 
lengths: 
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where: 



(i J) are the pixel coordinates; 

a n('»j) - attenuation at wavelength "n" for the pixel (i j); 

e m n = relative extinction coefficient for chromogen "m" at wavelength "n"; and 

C m (i,j) = relative concentration of chromogen "m" for pixel (ij). 

[0045] Using a method of linear algebra such as the Gauss-Jordan Elimination, this set of equations is inverted, in 



step 56, to yield a new system of equations for the concentration as a function of attenuation: 

10 

Ci(U) = k i,i * <*i(U) + a 2 (ij) + ... + k 1tfJ * a^ij) (10) 

C 2 (i*J) = k 2,1 •<*i(U) + k 2,2* a 2('>j) + - + k 2.n* a 7 ft D 
15 C mO>i) = k m,1 # <* + k m,2 9 * 2& D + - + k m ,n ' <* 1& J) 

where: 



(i.j) are the pixel coordinates; 

20 <x n (i,j) = attenuation at wavelength "n" for the pixel (ij); 

k m n = coefficients from matrix inversions; and 

C m (l,j) = relative concentration of chromogen "m" for pixel (i.j). 



In step 58 coefficients from the new equations in the table for the dye separator are installed. Note that the process of 
25 developing the concentration equations is performed at most once per specimen slide. However, during slide process- 
ing, new images are created for each field of view. If it is desired to analyze an image whose contrast is created only by 
the molecular marker, for example, then a new image is generated by subtracting the contributions from the morphology 
chromogens from the image captured using the filter matched to the molecular marker. A new morphology image might 
also be created with the molecular marker removed. For example, if we would like an image that displays only the 
30 absorption from chromogen 1 , which is centered on wavelength 1 , we remove the contributions from chromogens 2 and 
3 as follows: 

a r 0,j) = a jO'J) - e 21 • C 2 (i,j) -e 3 7 ♦ C 3 (i,J) (11) 

35 A new image is generated in step 60 from the calculated attenuation values using a default grayscale value N(0) for the 
full white level, as follows: 

G(i,j) = N(0) • e' av0J) (12) 

40 where: 

G(i,j) = gray level of pixel (ij) in new image; 

N(0) = gray level for the hypothetical clear area; and 

a 'i(ij) = computed attenuation after other chromogens removed. 

45 

The gray level of a hypothetical clear area N(0) is chosen based on the range of the grayscale values. For example an 
eight bit (0-255 range) may be assigned an N(0) of 238. The choice of chromogens retained in a new image will be 
made with the goal of improving object segmentation or strengthening particular object features to improve the perform- 
ance of the image analysis algorithms. 
so [0046] Alternatively, a new image may be created by varying extinction coefficients. 

For example, if the extinction coefficient £2,1 is changed from its measured value to a newe" 2 j, determined experimen- 
55 tally based on the behavior of a hypothetical chromogen, the new image would reflect this behavior. The grayscale value 
is adjusted in a similar manner to equation 1 2. 

[0047] An alternative new image is generated from the calculated attenuation values using a default grayscale 
value N(0) for the full white level, as follows: 
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G(i, j) = N(0) • e 



•<*r0'. i) 



(12.1) 



where 



G(iJ) 
N(0) 

a"i('j) 



= gray level of pixel (ij) in new image; 

= gray level for the hypothetical clear area; and 

= attenuation for hypothetical chromogen. 



[0048] In order to demonstrate the principles outlined above, images were collected at six wavelengths for a field of 
view from a cervical smear containing Papanicolaou stain. Figure 4 illustrates the selection of filters used. Four active 
dyes comprise the Papanicolaou mixture. Their names and their wavelengths of peak absorption are as follows: Orange 
G, 480 nm; Eosin Y, 520 nm; hematoxylin, 560 nm; and Light Green SF Yellowish, 630 nm. A fifth component, Bismarck 
Brown, has been shown to fail to stain cells. 

[0049] In the example of Figure 4, a specimen is stained with two dyes. The first dye absorbs most of its light at 
around 509 nm. The second dye absorbs at 630 nm. The system will capture six images at six wavelengths. This is 
basic information used to separate the dyes. 

[0050] The four active dyes combine to give absorption widely distributed in wavelength, with two major compo- 
nents. The first, which we will refer to as Chromogen 1, peaks around 510 nm. The second, Chromogen 2, peaks 
around 630 nm. The exact shape of the distributions and location of the peaks is variable. The hypothetical distributions 
in Figure 4 are presented to illustrate the concept of a two-component Chromogen system. It should also be noted that 
neither of the two components is limited to just the nucleus or just the cytoplasm. Both chromogens stain both nuclei 
and cytoplasm. Cytoplasm staining, furthermore, is dependent on the internal pH of the cell, which modulates the ratio 
of absorption between the shorter and the longer wavelengths. 

[0051] Figures 9, 1 0 and 1 1 show images collected at center wavelengths of 509, 555, and 608 nm, respectively, 
with the instrument shown in Figure 1. The system is known to be linear and of sufficient dynamic range to quantify 
attenuation over the full range of intensity of the light transmitted by the specimen. The grayscale level for the clear 
regions of the specimen were found for each wavelength, allowing the computation of attenuation values for all pixels 
at all three wavelengths. 

[0052] Figure 9 is an image of a slide using a 509 nm filter. Figures 9, 10 and show the same field of view with 
images collected at three different wavelengths. Note that the contrast changes from wavelength to wavelength. The fig- 
ures illustrate the effects of two different dyes staining both the nucleus and the cytoplasm, and the property that as the 
wavelength changes the contrast in those structures also changes. This gives information about the behavior of the two 
dye. This information is used in designing the chromogen separator. 

[0053] Now refer to Figure 12, Figure 12 illustrates the next step in the design of the chromogen separator. Figure 

12 demonstrates the behavior of the dye. Specialized masks are developed for separating one structure from another 
in the images. By separating nuclei from the rest of the image, the behavior of the dyes in the nuclei can be analyzed. 
Figure 12 shows the mask for selecting nuclei. As shown in Tables 1 and 2, calculations can be made of the relative 
extinction coefficients of the various dyes in the sample. 

[0054] Now refer to Figure 1 3, Figure 1 3 shows that the accuracy of the dye analysis can be demonstrated by using 
the extinction coefficient values produced by the analysis to subtract the effects of a dye from a captured image. Figure 

13 shows the image collected at 555 nm with the effects of chromogen 1 removed. Demonstrating that the extinction 
coefficients from the analysis were accurate. 

[0055] Now refer to Figure 14 which shows the further removal of the second dye leaving very little contrast in the 
resulting image further demonstrating the accuracy of the extinction coefficient. 
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[0056] Table 1 shows the outcome of the cross-correlation in which the 509 nm image was used as the reference 
image, and each of the other five wavelengths were tried as secondary wavelengths. Table 2 shows similar data with 
the 608 nm image serving as the reference. 
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[0057] As can be seen in Figure 4, contrast in the 555 nm Image is provided by strong contributions from both Chro- 
mogen 1 and C hromogen 2. The attenuation measurements at the adjacent wavelengths can be used to separate these 
two components of the attenuation at 555 nm. 

[0058] The offline extinction coefficient measurement method was used. Segmentation masks were produced by 
5 using the 657 nm, 555 nm, and 450 nm images as a red, green, and blue (RGB) triplet. The RGB triplet was converted 
to a hue, saturation, and value (HSV) triplet using an algorithm well known in the art. The segmentation was accom- 
plished by selecting pixels that fell inside narrow bands of both hue and saturation. 

[0059] From the pink/purple cytoplasm mask, a good estimate of the ratio of the extinction coefficients for Chro- 
mogen 1 at 555 nm and at 509 nm, which is about 0.59 (correlation of .944) was obtained. From the blue/green cyto- 
io plasm, a ratio of extinction coefficients of Chromogen 2 at 555 nm and at 608 nm of about 0.87 (correlation of 0.88) was 
obtained. 

[0060] Other inferences can be gleaned from the correlation data. A further evaluation was performed using the 
segmentation mask for nuclei shown in Figure 12. Both Chromogen 1 and Chromogen 2 stain the nuclei strongly, and 
act independently. However, a surprising rise in the correlation of the 608 nm image to the 450 and 410 nm images is 
75 seen for nuclei in Table 2. However, Conn's Biological Stains. Ninth Edition , page 472, cites a primary peak for hema- 
toxylin, which is a component of Chromogen 2, at 560 nm and a secondary peak at 430 nm, which explains the high 
correlation. This observation demonstrates the utility of the cross-correlation method. 

[0061] Using the extinction coefficient ratios from Tables 1 and 2, the contribution of Chromogen 1 can be removed 
from the image at 555 nm. The resulting new image is shown in Figure 13. Byway of illustration, we can take the next 
20 step of removing the contribution of Chromogen 2 from the new image. Ideally the result would be an empty (all white) 
image. Figure 14 shows the actual result. 

[0062] The determination of extinction coefficients is probably best performed using the offline method on carefully 
prepared test specimens, repeating the measurements periodically to check the stability of the staining process. If slide 
staining is very unstable, the option exists to use the online method to perform the extinction coefficient calculation on 

25 every slide. In this case, the number of cross-correlations can be restricted to just those cases where high correlation 
values are expected. That is, knowledge of how the chromogens should behave can reduce the amount of computation. 
The purpose of the computation would be that of refining the coefficient values to fit a particular specimen. 
[0063] Reter to Figures 1 5A, 15B and 1 5C that show a schematic diagram of one embodiment of the apparatus of 
the invention 1or performing slide classification from multiple wavelength images. While the method and apparatus of 

30 the invention will be discussed in terms of an example herein related to an automated cytology apparatus, it will be 
understood that the invention is not so limited. The features and principles of the invention may be applied to other bio- 
logical slide preparation types such as sputum slides, blood slides, other pathology slides, etc. 

[0064] The apparatus of the invention comprises an imaging system 502, a motion control system 504, an image 
processing system 536, a central processor 540, and a workstation 542. The imaging system 502 is comprised of an 

35 illuminator 508, imaging optics 510, a CCD camera 512, an illumination sensor 514 and an image capture and focus 
system 516. The camera may be a high-resolution camera as is well known in the art. The image capture and focus 
system 516 provides video timing data to the CCD cameras 512, the CCD cameras 512 provide images comprising 
scan lines to the image capture and focus system 516. Illumination sensor intensity is provided to the image capture 
and focus sysiem 516 where an illumination sensor 514 receives the sample of the image from the optics 510. In one 

40 embodiment ot the invention, the optics may further comprise an automated microscope. The illuminator 508 provides 
illumination of a slide. The image capture and focus system 516 provides data to a VME bus 538. The VME bus 538 
distributes the data to an image processing system 536. The image processing system 536 is comprised of field-of-view 
processors 568. The images are sent along the image bus 564 from the image capture and focus system 516. The cen- 
tral processor 540 controls the operation of the invention through the VME bus 538. In one embodiment, the central 

45 processor 562 comprises a Motorola 68060 CPU. The motion control system 504 is comprised of a tray handler 51 8, a 
microscope stage 520, a microscope turret 522, and a calibration slide 524. The motor drivers 526 position the slide 
under the optics. A bar code reader 528 reads a barcode located on the slide 524. A touch sensor 530 determines 
whether a slide is under the microscope objectives, and door interlock 532 prevents operation in case the doors are 
open. Motion controller 534 controls the motor drivers 526 in response to the central processor 540. An ETHERNET 

so communication system 560 communicates to a workstation 542 to provide control of the system. Workstation processor 
550 controls a hard disk 544. In one embodiment, workstation 542 may comprise a SUN SPARC ULTRA workstation. 
A tape drive 546 is connected to the workstation processor 550 as well as a modem 548, a monitor 552, a keyboard 
554, and a mouse-pointing device 556. A printer 558 is connected to the ETHERNET network system 560. 
[0065] During image collection integrity checking, the central processor 540, running a real time operating system, 

55 controls the automated microscope and the processor to acquire and digitize images from the microscope. The flatness 
of the slide may be checked, for example, by contacting the four corners of the slide using a computer controlled touch 
sensor. The central processor 540 also controls the microscope stage to position the specimen under the microscope 
objective, and from one to 1 5 field of view (FOV) processors 568 which receive images under control of the central proc- 
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essor 540. 

[0066] Referring now to Figure 15C, there is shown placement of a slide 12 into an optical path of an automated 
microscope 51 1 having a turret 522 and a CCD camera 512. The slide 12 may be mounted on a stage 520 substantially 
in a horizontal X,Y plane that intersects the optical path. The stage 520 is movable in the X, Y plane as well as along a 
5 Z axis which is perpendicular to the X, Y plane and which is parallel to the optical axis of the optics 51 0 of the automated 
microscope 51 1 . The turret 522 may comprise multiple objective lenses as is well known in the art. The microscope tur- 
ret control 523 provides signals in a well-known manner for positioning a selected objective lens into position for viewing 
the slide 12. Illuminator 508 illuminates the slide 12. 

[0067] It is to be understood that the various processes described herein may be implemented in software suitable 
io for running on a digital processor. The software may be embedded, for example, in the central processor 540. 

[0068] The slide 12 may be coverslipped. The coverslip may be detected following the methods described in 
assignee's United States Patents and copending United States Patent applications referred to herein. 
[0069] The automated analysis system may be operated in two modes: quality control mode and screening mode. 
In the quality control mode, the automated analysis system generates a quality control score. In the screening mode, 
is the automated analysis system generates an analysis score. These automated methods of performing screening and 
quality control steps employ software used by the central processor 540 to provide an analysis score or quality control 
score. The software operates on data that is a machine representation of a slide. The software employs thresholds that 
are used to determine the likelihood of normalcy or malignancy of the slide. The thresholds may also be used to deter- 
mine subpopulations of slides for quality control checking or to select subpopulations of slides that are so clearly normal 
20 that they do not need checking. 

[0070] The following United States Patents and Patent Applications are incorporated by reference hereto: 

U.S. Patent No. 5,315,700, issued 05/24/94 to Johnston et al., entitled METHOD AND APPARATUS FOR RAPIDLY 
PROCESSING DATA SEQUENCES; 
25 U.S. Patent No. 5,361,140, issued 11/01/94, to Hayenga et al., entitled METHOD AND APPARATUS FOR 

DYNAMIC CORRECTION OF MICROSCOPIC IMAGE SIGNALS; 

U.S. Patent No. 5,699,794, issued 12/23/97, to Fleck, entitled APPARATUS FOR AUTOMATED URINE SEDIMENT 
SAMPLE HANDLING; 

U.S. Patent No. 5,528,703, issued 06/18/96, to Lee, entitled FWC: METHOD FOR IDENTIFYING OBJECTS 
30 USING DATA PROCESSING TECHNIQUES, which is a file, wrapper continuation of abandoned U.S. Patent Appli- 

cation Serial No. 07/838,395, filed 02/18/92; 

pending U.S. Patent Application Serial No. 08/485,182, filed 06/07/95, to Lee et al., entitled INTERACTIVE 
METHOD AND APPARATUS FOR SORTING BIOLOGICAL SPECIMENS; 

U.S. Patent No. 5,647,025, issued 07/08/97, to Frost et al., entitled AUTOMATIC FOCUSING OF BIOMEDICAL 
35 SPECIMENS APPARATUS; 

U.S. Patent No. 5,912,699, issued 6/15/99 to Hayenga et al., entitled CIP: METHOD AND APPARATUS FOR 
RAPID CAPTURE OF FOCUSED MICROSCOPIC IMAGES, which is a continuation-in-part of abandoned U.S. 
Patent Application Serial No. 07/838,063, filed 02/18/92; 

U.S. Patent No. 5,715,326, issued 02/03/98, to Ortyn et al., entitled CYTOLOGICAL SYSTEM ILLUMINATION 
40 INTEGRITY CHECKING APPARATUS AND METHOD; 

U.S. Patent No. 5,581,631, issued 12/03/96, to Ortyn et al., entitled CYTOLOGICAL SYSTEM IMAGE COLLEC- 
TION INTEGRITY CHECKING APPARATUS; 

U.S. Patent No. 5,557,097, issued 09/17/96, to Ortyn et al., entitled CYTOLOGICAL SYSTEM AUTOFOCUS 
INTEGRITY CHECKING APPARATUS; 
45 U.S. Patent No. 5,499,097, issued 03/12/96, to Ortyn et al., entitled METHOD AND APPARATUS FOR CHECKING 

AUTOMATED OPTICAL SYSTEM PERFORMANCE REPEATABILITY; 

U.S. Patent No. 5,757,954, issued 05/26/98, to Kuan et al., entitled FIELD PRIORITIZATION APPARATUS AND 
METHOD; 

U.S. Patent No. 5,627,908, issued 05/06/97, to Lee et al., entitled METHOD FOR CYTOLOGICAL SYSTEM 
50 DYNAMIC NORMALIZATION; 

U.S. Patent No. 5,638,459, issued 06/10/97, to Rosenlof et al., entitled METHOD AND APPARATUS FOR 
DETECTING A MICROSCOPE SLIDE COVERSLIP; 

U.S. Patent No. 5,566,249, issued 10/15/96, to Rosenlof etal., entitled APPARATUS FOR DETECTING BUBBLES 
IN COVERSLIP ADHESIVE; 

55 allowed U.S. Patent Application Serial No. 08/309,250, filed 09/20/94, for which the issue fee has been paid, to Lee 

et al., entitled APPARATUS FOR THE IDENTIFICATION OF FREE-LYING CELLS; 

U.S. Patent No. 5,740,269, issued 04/14/98, to Oh et al, entitled A METHOD AND APPARATUS FOR ROBUST 
BIOLOGICAL SPECIMEN CLASSIFICATION; 
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U.S. Patent No. 5,715,327, issued 02/03/98, to Wilhelm et a!., entitled METHOD AND APPARATUS FOR DETEC- 
TION OF UNSUITABLE CONDITIONS FOR AUTOMATED CYTOLOGY SCORING; 

U.S. Patent No. 5,692,066, issued 1 1/25/97, to Lee et aL, entitled METHOD AND APPARATUS FOR IMAGE 
PLANE MODULATION PATTERN RECOGNITION; 
5 U.S. Patent No. 5,671 ,288, issued 09/23/97, to Wilhelm et aL, entitled METHOD AND APPARATUS FOR ASSESS- 

ING SLIDE AND SPECIMEN PREPARATION QUALITY; 

U.S. Patent No. 5,619,428, issued 04/08/97, to Lee et al., entitled METHOD AND APPARATUS FOR INTEGRAT- 
ING AN AUTOMATED SYSTEM TO A LABORATORY; 

U.S. Patent No. 5,621,519, issued 04/15/97, to Frost et al., entitled IMAGING SYSTEM TRANSFER FUNCTION 
w CONTROL METHOD AND APPARATUS; 

U.S. Patent No. 5,642,441, issued 06/24/97, to Riley et al., entitled APPARATUS AND METHOD FOR MEASUR- 
ING FOCAL PLANE SEPARATION; 

U.S. Patent No. 5,787,208, issued 07/28/98, to Oh et aL, entitled IMAGE ENHANCEMENT METHOD AND APPA- 
RATUS; 

is pending U.S. Patent Application Serial No. 08/924,351, filed 09/05/97, to Kuan et al., entitled DYNAMIC CONTROL 

AND DECISION MAKING METHOD AND APPARATUS; 

U.S. Patent No. 5,625,706, issued 04/29/97, to Lee et al., entitled METHOD AND APPARATUS FOR CONTINU- 
OUSLY MONITORING AND FORECASTING SLIDE AND SPECIMEN PREPARATION FOR A BIOLOGICAL 
SPECIMEN POPULATION; 

20 U.S. Patent No. 5,745,601, issued 04/28/98, to Lee et al., entitled ROBUSTNESS OF CLASSIFICATION MEAS- 

UREMENT APPARATUS AND METHOD; 

U.S. Patent No. 5,781 ,667, issued 07/1 4/98, to Schmidt et al., entitled APPARATUS FOR HIGH SPEED MORPHO- 
LOGICAL PROCESSING; 

U.S. Patent No. 5,642,433, issued 06/24/97, to Lee et aL, entitled METHOD AND APPARATUS FOR IMAGE CON- 
25 TRAST QUALITY EVALUATION; 

U.S. Patent No. 5,797,130, issued 08/18/98, to Nelson et al., entitled FWC: METHOD FOR TESTING PROFI- 
CIENCY IN SCREENING IMAGES OF BIOLOGICAL SLIDES, which is a file wrapper continuation of abandoned 
U.S. Patent Application Serial No. 08/153,293, filed 11/1 6/93; 

U.S. Patent No. 5,787,188, issued 07/28/98, to Nelson etal., entitled FWC: METHOD FOR IDENTIFYING NOR- 
30 MAL BIOMEDICAL SPECIMENS, which is a file wrapper continuation of abandoned U.S. Patent Application Serial 

No. 07/838,064, filed 02/18/92, to Nelson et al.; 

U.S. Patent No. 5,710,842, issued 01/20/98, to Lee entitled DIV: METHOD FOR IDENIFYtNG OBJECTS USING 
DATA PROCESSING TECHNIQUES, which is a divisional of U.S. Patent No. 5,528,703, ibid., which is a file wrap- 
per continuation of abandoned U.S. Patent Application Serial No. 07/838,395, filed 02/1 8/92; 
35 allowed U.S. Patent Application Serial No. 08/788,239, for which the issue fee has been paid, filed 01/25/97, to Oh 

et aL, entitled METHOD AND APPARATUS FOR ALIAS FREE MEASUREMENT OF OPTICAL TRANSFER 
FUNCTION; 

U.S. Patent No. 5,677,762, issued 10/14/97, to Ortyn et al., entitled FWC: APPARATUS FOR ILLUMINATION STA- 
BILIZATION AND HOMOGENIZATION, which is a file wrapper continuation of abandoned U.S. Patent Application 
40 Serial No. 08/309,064, filed 09/20/94; 

U.S. Patent No. 5,787,189, issued 07/28/98, to Lee et al., entitled FWC: BIOLOGICAL ANALYSIS SYSTEM SELF 
CALIBRATION APPARATUS, which is a file wrapper continuation of abandoned U.S. Patent Application Serial No. 
08/309,1 1 5, filed 09/20/94; 

U.S. Patent No. 5,654,535, issued 08/05/97, to Ortyn et al., entitled DIV: CYTO LOGICAL SYSTEM AUTOFOCUS 
45 INTEGRITY CHECKING APPARATUS, which is a divisional of U.S. Patent No. 5,557,097, ibid.; 

U.S. Patent No. 5,828,776, issued 10/27/98, to Lee et al., entitled FWC: APPARATUS FOR IDENTIFICATION AND 
INTEGRATION OF MULTIPLE CELL PATTERNS, which is a file wrapper continuation of abandoned U.S. Patent 
Application Serial No. 08/308,992, filed 09/20/94, to Lee et al.; 

pending U.S. Patent Application Serial No. 09/121 ,012, filed 07/22/98, to Lee et al., entitled DIV: APPARATUS FOR 
so THE IDENTIFICATION OF FREE-LYING CELLS, which is a divisional of allowed U.S. Patent Application Serial No. 

08/309,250, ibid.; 

pending U.S. Patent Application Serial No. 09/120,860, filed 07/22/98, to Lee et al., entitled DIV: APPARATUS FOR 
THE IDENTIFICATION OF FREE-LYING CELLS, which is a divisional of allowed U.S. Patent Application Serial No. 
08/309,250, ibid.; 

55 pending U.S. Patent Application Serial No. 09/120,612, filed 07/22/98, to Lee et aL, entitled DIV: APPARATUS FOR 

THE IDENTIFICATION OF FREE-LYING CELLS, which is a divisional of allowed U.S. Patent Application Serial No. 
08/309,250, ibid.; 

U.S. Patent No. 5,875,258, issued 2/23/99, to Ortyn et al., entitled FWC: BIOLOGICAL SPECIMEN ANALYSIS 
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SYSTEM PROCESSING INTEGRITY CHECKING APPARATUS, which is a file wrapper continuation of abandoned 
U.S. Paient Application Serial No. 08/309,249, filed 09/20/94; 

U.S. Patent No. 5,812,692 : issued 09/22/98, to Rosenlof et al., entitled DIV: METHOD AND APPARATUS FOR 
DETECTING A MICROSCOPE SLIDE COVERSLIP, which is a divisional of U.S. Patent No. 5,638,459, ibid.; 
5 pending U.S. Patent Application Serial No. 08/767,457, filed 12/16/96, to Lee et al., entitled METHOD AND APPA- 

RATUS FOR EFFICACY IMPROVEMENT IN MANAGEMENT OF CASES WITH EQUIVOCAL SCREENING 
RESULTS; 

pending U.S. Patent Application Serial No. 08/877,368, filed 06/17/97, to Lee et al., entitled DIV: METHOD AND 
APPARATUS FOR IMAGE PLANE MODULATION PATTERN RECOGNITION, which is a divisional of U.S. Patent 
io No. 5,692,066, ibid.; 

U.S. Patent No. 5,892,218, issued 4/6/99, to Ortyn et al., entitled DIV: CYTOLOGICAL SYSTEM AUTOFOCUS 
INTEGRITY CHECKING APPARATUS, which is a divisional of U.S. Patent No. 5,654,535, ibid., which is a divisional 
of U.S. Patent No. 5,557,097, ibid.; 

U.S. Patent No. 5,760,387, issued 06/02/98, to Ortyn et al., entitled DIV: CYTOLOGICAL SYSTEM AUTOFOCUS 
is INTEGRITY CHECKING APPARATUS, which is a divisional of U.S. Patent No. 5,654,535, ibid., which is a divisional 

of U.S. Patent No. 5,557,097, ibid.; 

U.S. Patent No. 5,841,124, issued 11/24/98, to Ortyn et al., entitled DIV: CYTOLOGICAL SYSTEM AUTOFOCUS 
INTEGRITY CHECKING APPARATUS, which is a divisional of U.S. Patent No. 5,654,535, ibid., which is a divisional 
of U.S. Patent No. 5,557,097, ibid.; 
20 U.S. Patent No. 5,763,871, issued 06/09/98, to Ortyn et al., entitled DIV: CYTOLOGICAL SYSTEM AUTOFOCUS 

INTEGRITY CHECKING APPARATUS, which is a divisional of U.S. Patent No. 5,654,535, ibid., which is a divisional 
of U.S. Patent No. 5,557,097, ibid.; 

U.S. Patent No. 5,877,489, issued 3/2/99, to Ortyn et al., entitled DIV: CYTOLOGICAL SYSTEM AUTOFOCUS 
INTEGRITY CHECKING APPARATUS, which is a divisional of U.S. Patent No. 5,654,535, ibid., which is a divisional 
25 of U.S. Patent No. 5,557,097, ibid.; 

U.S. Patent No. 5,883,982, issued 3/1 6/99, to Riley et al., entitled DIV: ASTIGMATISM MEASUREMENT APPARA- 
TUS AND METHOD BASED ON A FOCAL PLANE SEPARATION, which is a divisional of U.S. Patent No. 
5,642,441, ibid.; 

allowed U.S. Patent Application Serial No. 08/900,341, filed 07/25/97, for which the issue fee has been paid, to 
30 Riley et ai., entitled MODULATION TRANSFER FUNCTION TEST COMPENSATION FOR TEST PATTERN DUTY 

CYCLE; 

pending U.S. Patent Application Serial No. 08/888,1 15, filed 07/03/97, to Lee et al., entitled METHOD AND APPA- 
RATUS FOR MASKLESS SEMICONDUCTOR AND LIQUID CRYSTAL DISPLAY INSPECTION; 
pending U.S. Patent Application Serial No. 08/888,120, filed 07/03/97, to Lee et al., entitled METHOD AND APPA- 
35 RATUS FOR A REDUCED INSTRUCTION SET ARCHITECTURE FOR MULTIDIMENSIONAL IMAGE PROCESS- 

ING; 

pending U.S. Patent Application Serial No. 08/888,1 19, filed 07/03/97, to Lee et al., entitled METHOD AND APPA- 
RATUS FOR INCREMENTAL CONCURRENT LEARNING IN AUTOMATIC SEMICONDUCTOR WAFER AND LIQ- 
UID CRYSTAL DISPLAY DEFECT. CLASSIFICATION; 
40 pending U.S. Patent Application Serial No. 08/888,1 1 6, filed 07/03/97, to Lee et al., entitled METHOD AND APPA- 

RATUS FOR SEMICONDUCTOR WAFER AND LCD INSPECTION USING MULTIDIMENSIONAL IMAGE 
DECOMPOSITION AND SYNTHESIS; 

pending U.S. Patent Application Serial No. 09/006,457, filed 01/13/98, to Kuan et al., entitled A METHOD AND 
APPARATUS FOR OPTIMIZING BIOLOGICAL AND CYTOLOGICAL SPECIMEN SCREENING AND DIAGNO- 
45 SIS; 

allowed U.S. Patent Application Serial No. 08/867,01 7, filed 06/03/97, for which the issue fee has been paid, to Lee 
et al., entitled FWC: CYTOLOGICAL SLIDE SCORING APPARATUS, which is a file wrapper continuation of aban- 
doned U.S. Patent Application Serial No. 08/309,931, filed 09/20/94; 

U.S. Patent No. 5,587,833, issued 12/24/96, to Kamentsky entitled COMPUTERIZED MICROSCOPE SPECIMEN 
so ENCODER; 

U.S. Patent No. 5,602,674, issued 02/11/97, to Weissman et al., entitled COMPUTERIZED SPECIMEN 
ENCODER; 

U.S. Patent No. 5,561,556, issued 10/01/96, to Weissman entitled SLIDE ANALYSIS SYSTEM WITH SLIDE HAV- 
ING SELF CONTAINED MICROSCOPE ANALYSIS INFORMATION; 
55 U.S. Patent No. 5,793,969, issued 08/1 1/98, to Kamentsky et al., entitled NETWORK REVIEW AND ANALYSIS OF 

COMPUTER ENCODER SLIDES; 

U.S. Patent No. 5,790,308, issued 08/04/98, to Kamentsky entitled COMPUTERIZED MICROSCOPE SPECIMEN 
ENCODER; 
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U.S. Patent No. 5,694,212, issued -,2702/97, to Weissman, entitled METHOD FOR CALIBRATING SPECIMEN 
WITH SPECIMEN HOLDER OF A MICROSCOPE; 

U.S. Patent No. 5,581,487, issued 12/03/96, to Kelly entitled METHOD AND APPARATUS FOR MICROSCOPIC 
SCREENING OF CYTOLOGICAL SAMPLES; 

5 U.S. Patent No. 5,867,610, issued 2/2/99, to Lee entitled DIV: METHOD FOR IDENTIFYING OBJECTS USING 

DATA PROCESSING TECHNIQUES, which is a divisional of U.S. Patent No. 5,710,842, ibid.; 
U.S. Patent No. 5,799,101, issued 08/25/98, to Lee et al., entitled FWC: METHOD AND APPARATUS FOR HIGHLY 
EFFICIENT COMPUTER AIDED SCREENING, which is a file wrapper continuation of abandoned U.S. Patent 
Application Serial No. 08/315,719, filed 09/30/94; 

10 pending U.S. Patent Application Serial No. 08/912,061 , filed 08/15/97, to Ortyn et al., entitled DIV: CYTOLOGICAL 

SYSTEM ILLUMINATION INTEGRITY CHECKING APPARATUS AND METHOD, which is a divisional of U.S. Pat- 
ent No. 5,715,326, ibid.; 

pending U.S. Patent Application Serial No. 08/911,807, filed 08/15/97, to Ortyn et al., entitled DIV: CYTOLOGICAL 
SYSTEM ILLUMINATION INTEGRITY CHECKING APPARATUS AND METHOD, which is a divisional of U.S. Pat- 
75 ent No. 5,715,326, ibid.; 

pending U.S. Patent Application Serial No. 08/91 1 ,61 2, filed 08/1 5/97, to Ortyn et al., entitled DIV: CYTOLOGICAL 
SYSTEM ILLUMINATION INTEGRITY CHECKING APPARATUS AND METHOD, which is a divisional of U.S. Pat- 
ent No. 5,715,326, ibid.; 

pending U.S. Patent Application Serial No. 08/912,1 15, filed 08/15/97, to Ortyn et al., entitled DIV: CYTOLOGICAL 
20 SYSTEM ILLUMINATION INTEGRITY CHECKING APPARATUS AND METHOD, which is a divisional of U.S. Pat- 

ent No. 5,715,326, ibid.; 

pending U.S. Patent Application Serial No. 08/91 1 ,644, filed 08/15/97, to Ortyn et al., entitled DIV: CYTOLOGICAL 
SYSTEM ILLUMINATION INTEGRITY CHECKING APPARATUS AND METHOD, which is a divisional of U.S. Pat- 
ent No. 5,715,326, ibid.; 

25 pending U.S. Patent Application Serial No. 08/91 1 ,61 1 , filed 08/15/97, to Ortyn et al., entitled DIV: CYTOLOGICAL 

SYSTEM ILLUMINATION INTEGRITY CHECKING APPARATUS AND METHOD, which is a divisional of U.S. Pat- 
ent No. 5,715,326, ibid.; 

allowed U.S. Patent Application Serial No. 08/969,970, filed 1 1/13/97, to Meyer et al., entitled FWC: APPARATUS 
FOR AUTOMATED IDENTIFICATION OF THICK CELL GROUPINGS ON A BIOLOGICAL SPECIMEN, which is a 

30 file wrapper continuation of abandoned U.S. Patent Application Serial No. 08/309,116, filed 09/20/94; 

allowed U.S. Patent Application Serial No. 08/927,379, filed 09/1 2/97, to Wilhelm et al., entitled FWC: APPARATUS 
FOR AUTOMATED IDENTIFICATION OF CELL GROUPINGS ON A BIOLOGICAL SPECIMEN, which is a file 
wrapper continuation of abandoned U.S. Patent Application Serial No. 08/309,061 , filed 09/20/94; 
pending U.S. Patent Application Serial No. 08/970,904, filed 1 1/14/97, to Weissman et al., entitled FWC: FOLDING 

35 SLIDE HOLDER, which is a file wrapper continuation of abandoned U.S. Patent Application Serial No. 08/582,495, 

filed 01/03/96; 

pending U.S. Patent Application Serial No. 09/014,984, filed 01/28/98, to Ellison et al., entitled METHOD AND 
APPARATUS FOR RANKED REVIEW OF BIOLOGICAL SPECIMENS; 

U.S. Patent No. 5,862,265, issued 1/19/99, to Riley et al., entitled DIV: ASTIGMATISM MEASUREMENT APPARA- 
40 TUS AND METHOD, which is a divisional of U.S. Patent No. 5,883,982, ibid., which is a divisional of U.S. Patent 

No. 5,642,441 , ibid.; 

pending U.S. Patent Application Serial No. 09/082,580, filed 05/21/98, to Kuan et al., entitled DIV: FIELD PRIORI- 
TIZATION APPARATUS AND METHOD, which is a divisional.of U.S. Patent No. 5,757,954, ibid.; 
pending U.S. Patent Application Serial No. 09/291,531, filed 4/14/99 to Boisseranc et al., entitled METHOD AND 
45 APPARATUS FOR DETERMINING MICROSCOPE SPECIMEN PREPARATION TYPE; 

pending U.S. Patent Application Serial No. 09/291,519, filed 4/14/99 to Boisseranc et al., entitled METHOD AND 
APPARATUS FOR DETERMINING MICROSCOPE SPECIMEN PREPARATION TYPE; 

A Continued Prosecution Application entitled CPA: METHOD AND APPARATUS FOR DETECTION OF UNSUITA- 
BLE CONDITIONS FOR AUTOMATED CYTOLOGY SCORING of prior U.S. Patent Application Serial No. 

50 08/914,292, filed 08/18/97, to Wilhelm et al., which is a divisional of U.S. Patent No. 5,715,327, ibid.; 

a Continued Prosecution Application entitled CPA: APPARATUS FOR AUTOMATED IDENTIFICATION OF THICK 
CELL GROUPINGS ON A BIOLOGICAL SPECIMEN of prior U.S. Patent Application Serial No. 08/969,970, ibid., 
which is a file wrapper continuation of abandoned U.S. Patent Application Serial No. 08/309,1 16, ibid.; 
a Continued Prosecution Application entitled CPA: CYTOLOGICAL SYSTEM ILLUMINATION INTEGRITY 

55 CHECKING APPARATUS AND METHOD of prior U.S. Patent Application Serial No. 08/91 1,61 1, ibid, which is a 

divisional of U.S. Patent No. 5,715,326, ibid.; and 

a Continued Prosecution Application entitled CPA: CYTOLOGICAL SYSTEM ILLUMINATION INTEGRITY 
CHECKING APPARATUS AND METHOD of prior U.S. Patent Application Serial No. 08/91 1,612, ibid, which is a 
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divisional of U.S. Patent No. 5,715,326, ibid. 

[0071 J The invention has been described herein in considerable detail in order to comply with the Patent Statutes 
and tc . prov.de those skil.ed in the art with the information needed to apply the novel principled to coLtuc and use 

JoeciS ™ T P ° nentS 88 reqUired - H0WeVer ' * 15 ,0 be ^erstood that the invention can be carried om by 
specifically d.fferent equipment and devices, and that various modifications, both as to the equipment details and oner 
atmg procedures, can be accomplished without departing from the scope of the invention itself P 

Claims 

1. A method for collecting images from a field of view useful for chromogen processing, comprising the steps of: 

(a) Ruminating the field of view with a narrow band of illumination wavelengths with a unique center wave- 
's (b) generating a first image of the field of view for chromogen processing- 

(d) generating a second image of the field of view for chromogen processing. 
20 ^ Z^lToZZT^ ima96S ° f 3 bi0l09iCa ' SP6Cimen Wh6rein bi ° ,09iCa ' ^™ - b -n 

raLroTpixds;" 1396 * ^ bi0l ° 9iCal SP6Cimen * * WaVelen 9 th of interest where >" the image comprises a plu- 
ss (b) measure the zero attenuation grayscale value from clear areas of the image- 

piie C rvTues e ; ,he attenUati ° n COeffident f ° r a " P ixels in ,he ima 9 e f ™ the zero attenuation grayscale value and 

.he XTngt: oSr^ " ^ C ° nCenUati ° n ^ m *r »- chromogen at 

ficlent'^ C ° nCemrati0n ° f the chr °™9en at each pixel by dividing the attenuation by the extinction coef- 

3. The method of claim 2 wherein the zero attenuation grayscale value is G N (0) and the attenuation coefficient c^ij) 



35 



*o where 



55 



n = index identifying filter with center wavelength A^; 

G n(' J) = grayscale value for pixel i j in image collected atX n ; 

G n (0) = grayscale value for zero attenuation in specimen using filter n; and 

a n('J) = attenuation coefficient for pixel i j. 

4. The method of claim 2 wherein the attenuation coefficient is: 

&>0\j) = e • C 

where: 

e = the extinction coefficient for the chromogen; and 
C = the concentration of the chromogen. 

5. A method for separating contrast in an image of a biological specimen wherein the biological specimen has been 
prepared with multiple chromogens: Hewmen rids oeen 
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(a) obtaining multiple images of the biological specimen wherein each image is taken at a wavelength ot inter- 
est wherein each image comprises a plurality of pixels; 

(b) measuring a zero attenuation grayscale value for each image in clear areas; 

(c) computing attenuation coefficients for all pixels in each image from the zero attenuation grayscale value and 
5 pixel value; and 

(d) computing the concentration of each chromogen at a pixel location based on the attenuation coefficients 
and extinction coefficients at each wavelength of interest. 

6. The method of claim 5 further comprising the steps of: 

70 

(a) expressing the attenuation coefficients as the sum of the products of the extinction coefficients at each 
wavelength of interest times the concentration for each chromogen; and 

(b) computing the concentration of each chromogen at a pixel location by a series of matrix inversions. 



is 7. The method of claim 5 wherein the zero attenuation grayscale value is G n (0) and the attenuation coefficient a n (i j) is 



20 



(G n (i,jK 



where 



n = index identifying filter with center wavelength X n ; 

Gn(' J) = grayscale value for pixel i,j in image collected at A^; 

25 Gn(0) = grayscale value for zero attenuation in specimen using filter n; and 

a n(U) - attenuation coefficient for pixel i,j. 

8. The method of claim 5 wherein the attenuation coefficients are expressed as: 



30 



« lO'J) = e 1,1 * C A J) + e 2.1 • C 2(t>j) + - + e m t 7 * C mP>j) 
<l 2 (i>i) = e 1,2* C l('>i) + ^2,2 # C 20'D + • - + Zm,2 * C m('>j) 



« nft j) = Zl,n* C 7ft J) + &2.n * C 2^ D + ... + E m>n • C m (i, j) 

35 

where: 



(i,j) are the pixel coordinates; 

a n('J) = attenuation at wavelength "n" for the pixel (i,j); 

40 e m n = relative extinction coefficient for- chromogen "m" at wavelength "n"; and 

Cm(ij) ~ relative concentration of chromogen "m" for pixel (i j). 



9. The method of claim 5 wherein the concentration is: 
45 C ^0,1) = k 1 y • a 7 fc/; + k 12 ♦ a 2 (i,j) + a^ij) (10) 



C 2 (i,i) = k 21 • a + k 22 • a 2 (i,j) +- ... + k 2 n • a rf, j) 

C m(i>i) = k m,1 • a Ai) + k m,2* a 2^ I) + - + k m .„ m « 1 ft J) 

50 

where: 



(ij) are the pixel coordinates; 

a n (ij) = attenuation at wavelength "rf for the pixel (ij); 

55 k m n = coefficients from matrix inversions; and 

C m (i j) = relative concentration of chromogen "m" for pixel (ij). 



10. The method of claim 7 further comprising the step of creating a new image a(i j) according to: 
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= a ,(*,]) - z 2t i * c 2 (' l >i) - e 3.r # c 3('j) 



G(i,j) = N(0) - e' a ' Ai) (12 ) 



where: 



75 



20 



= gray level of pixel (ij) in new image; 
N(0) = gray level for the hypothetical clear area; and 

cC, (i j) = computed attenuation after other chromogens removed. 

11. The method of claim 5 further comprising the step of creating a new image a'(ij) according to equation: 

*"lO,j) = £ 7 .T • C lfl>j) + Z 2 " 7 * C 2 0J) + *3.1 * C 3 ('J) 

G(i,j)= N(0) • e' a 'i (iJ) 
where: 

G(i,j) = gray level of pixel (i,j) in new image; 

N(0) = gray level for the hypothetical clear area; and 

25 ot"i(ij) = attenuation for hypothetical chromogen. 

12. A method for biological specimen image analysis on a plurality of images collected at multiple wavelengths com- 
prising the steps of: 

30 (a) applying a chromogen separator to the plurality of images to generate a set of new images; 

(b) segmenting the each image of the set of new images to provide a plurality of segmented outputs; 

(c) performing feature calculation on each of the plurality of segmented outputs wherein data from each of the 
segmented outputs is used on each feature calculation to provide a plurality of feature calculation results; 

(d) performing object classification on each of the feature calculation results wherein data from each of thefea- 
35 ture calculation results is used on each object classification to provide a plurality of object classification results; 

(e) integrating the object classification results to provide a field of view score integrated output; and 

(f) generating a slide score from the field of view score integrated output. 

13. The method of computing extinction coefficients from a specimen containing a single chromogen comprising the 
40 steps of: 

(a) selecting a field of view of an image of the specimen at a wavelength of interest; 

(b) finding the zero attenuation gray level for the wavelength of interest; 

(c) segmenting the field of view into structures using morphological infrastructures of interest; 
45 (d) converting the grayscale value into attenuation values; 

(e) selecting an image of maximum attenuation as a reference image; and 

(f) computing an extinction coefficient for the image. 

14. The method of claim 13 wherein the extinction coefficient is computed by: 

50 



-sec E ^ A 



refl 



55 where: 



A S ec = attenuation in secondary image, a random variable; 

A ref = attenuation in the reference image, a random variable; and 
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E[X] = expectation operator, rMurns the average of random variable X. 
15. The method of claim 13 wherein tr.e extinction coefficient is computeo as an average over multiple fields of view. 

5 16. The method of computing relative extinction coefficients from a specimen containing multiple chromogens compris- 
ing the steps of: 

(a) imaging the specimen to collect multiple images of the specimen, wherein each image is collected at a 
wavelength of interest; 
io (c) finding the zero attenuation gray level for each image; 

(d) converting the grayscale level into attenuation values; 

(f) selecting an image with maximum attenuation as a reference image for each chromogen; and 

(g) computing a relative extinction coefficient for each chromogen. 

75 17. The method of claim 1 6 wherein the relative extinction coefficient is computed as an average over multiple fields of 
view. 

18. The method of claim 1 6 wherein an image further comprises pixels and wherein the step of calculating the relative 
extinction coefficient comprises the steps of: 

20 

(a) setting an attenuation window for mask generation by comparing the reference image to another image; 

(b) generating a segmentation mask comprising all pixels that are in the attenuation window; 

(c) computing a correlation coefficient of the elements in the image corresponding to the segmentation mask; 

(d) determining whether the correlation coefficient is greater than a predetermined limit and if it is not adjusting 
25 the attenuation window and returning to step (b) to generate another segmentation mask and if the correlation 

coefficient is greater than the predetermined limit then calculating an extinction coefficient for this image. 

19. The method of claim 16 wherein the extinction coefficient is computing according to the following equation: 



35 



55 



E[A r 



where: 



Ag ec = attenuation in secondary image, a random variable; 

A ref = attenuation in the reference image, a random variable; 

f = index for the field of view; 

m = index for the chromogen; and 

40 n = index for the secondary wavelength. 

20. The method of claim 16 wherein the extinction coefficients are computed for all images. 

21 . The method of claim 20 wherein the correlation coefficient is computed according to: 

45 

Cov[A 1f A P ] 

p(A v A 2 ) = . 

JVariA, • Var(A 2 ) 

so where: 

Cov \A v Ag] = E [A , • AJ-EIA,] - E[A 2 ] 



Var[4,]= E[/\f]-(£[/\,]) 2 
Var[A 2 ]= E[A*] = (E[A Z ])* 



attenuation at wavelength n, a random variable. 
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22. A method for collecting images at multiple illumination wavelengths for image analysis of biological specimens, 
wherein the method comprises the steps of: 

(a) providing a biological specimen on a slide; 
5 (b) staining the biological specimen with a molecular marker; 

(c) staining the biological specimen with a morphology marker; 

(d) illuminating the biological specimen with light having a first center wavelength; 

(e) acquiring a first image of the biological specimen; 

(f) illuminating the biological specimen with light having a second center wavelength; and 
io (g) acquiring a second image of the biological specimen. 

23. The method of claim 22 wherein a plurality of filters and a broadband incandescent light source provides light for 
each image at a different center wavelength. 

is 24. The method of claim 22 wherein an electronically controlled variable filter and a broadband incandescent light 
source provides light for each image at a different center wavelength. 

25. The method of claim 22 wherein a center wavelength for each image is matched to a stain. 

20 26. The method of claim 22 wherein a maximum spatial offset between the first and second image is less than a pixel 
width. 

27. The method of claim 22 wherein a monochromatic camera provides for image acquisition. 

25 28. The method of claim 27 further comprising the step of storing the first image and the second image. 

29. The method of claim 28 further comprising the step of performing image analysis on the first image and the second 
image. 

30 30. A method of online determination of relative extinction coefficients for chromogens in a biological specimen com- 
prising the steps of: 

(a) imaging the biological specimen at multiple wavelengths of interest to generate multiple images; and 

(b) computing the relative extinction coefficients online based on the multiple images. 

35 
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Image Collected Using 555 nm Filter 
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Image Collected Using 608 nm Filter 
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Image at 555 nm minus Chromogen 1 
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